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Abstract 

Background: Robotic surgery offers many potential benefits for patients. While an increasing number of healthcare 
providers are purchasing surgical robots, there are reports that the technology is failing to be introduced into 
routine practice. Additionally, in robotic surgery, the surgeon is physically separated from the patient and the rest 
of the team, with the potential to negatively impact teamwork in the operating theatre. The aim of this study is to 
ascertain: how and under what circumstances robotic surgery is effectively introduced into routine practice; and 
how and under what circumstances robotic surgery impacts teamwork, communication and decision making, 
and subsequent patient outcomes. 

Methods and design: We will undertake a process evaluation alongside a randomised controlled trial comparing 
laparoscopic and robotic surgery for the curative treatment of rectal cancer. Realist evaluation provides an overall 
framework for the study. The study will be in three phases. In Phase I, grey literature will be reviewed to identify 
stakeholders' theories concerning how robotic surgery becomes embedded into surgical practice and its impacts. 
These theories will be refined and added to through interviews conducted across English hospitals that are using 
robotic surgery for rectal cancer resection with staff at different levels of the organisation, along with a review of 
documentation associated with the introduction of robotic surgery. In Phase II, a multi-site case study will be conducted 
across four English hospitals to test and refine the candidate theories. Data will be collected using multiple methods: 
the structured observation tool OTAS (Observational Teamwork Assessment for Surgery); video recordings of operations; 
ethnographic observation; and interviews. In Phase III, interviews will be conducted at the four case sites with staff 
representing a range of surgical disciplines, to assess the extent to which the results of Phase II are generalisable and to 
refine the resulting theories to reflect the experience of a broader range of surgical disciplines. The study will provide (i) 
guidance to healthcare organisations on factors likely to facilitate successful implementation and integration of robotic 
surgery, and (ii) guidance on how to ensure effective communication and teamwork when undertaking robotic surgery. 
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Background 

The past two decades have seen a revolution in general 
surgical practice. In the 1990s, traditional open surgery 
was challenged by the introduction of laparoscopic tech- 
niques, initially for benign conditions, but later extended 
to the treatment of cancer. Instead of producing large 
abdominal wounds, the surgeon is able to perform oper- 
ations using small 'key-hole' incisions, through which 
cameras and instruments are passed. This effectively 
removes much of the abdominal access trauma. The 
clinical benefits were soon realised, including less post- 
operative pain, shorter hospitalisation, quicker return to 
normal function, and improved cosmetic effect [1-3]. 
However, laparoscopic operations are technically more 
challenging than open surgery, as a result of the two- 
dimensional operative image, instrumentation with lim- 
ited freedom of movement, and lack of tactile feedback. 
The uptake of laparoscopic surgery has therefore been 
slow; in 2003, the uptake in colorectal surgery was 5% 
and had increased to only 40% over the 9 years to 2011 
[4], despite being recommended by the National Insti- 
tute for Health and Care Excellence (NICE) since 2006. 
Robotic surgery offers to solve some of the limitations of 
the laparoscopic approach. A surgical cart carries four 
robotic arms, one of which holds the camera, while the 
other arms hold a variety of surgical instruments. These 
robotic arms are controlled by the surgeon remotely. 
The robot provides a stable camera image with three- 
dimensional field of view, with instruments that provide 
increased freedom of movement, and a digital platform 
that enables intuitive instrument handling, tremor elim- 
ination, and motion scaling. This enables the surgeon to 
achieve greater precision and control and simplifies 
many of the tasks that are difficult with traditional 
laparoscopy. 

Enthusiasm for robotic surgery is expressed by both 
clinicians and policy makers [5-7]. Despite this, the 
many potential benefits robotic surgery offers for pa- 
tients are currently not being realised to the full extent 
because of underuse of surgical robots [8]. Robotic sur- 
gery is a complex intervention, by which we mean that it 
is an intervention aimed at producing change in the de- 
livery and organisation of healthcare services and which 
comprises a number of separate components that may 
act both independently and interdependently [9,10]. 
These components are not only technological but also 
organisational and social, and they can all impact the ex- 
tent to which the technology is successfully introduced, 
as well as subsequent process and patient outcomes. 
The successful performance of a surgical operation is 
dependent on collaboration amongst staff from different 
professional groups, including surgeons, anaesthetists, 
nursing staff, and operating department practitioners 
(ODPs). There is a complex division of labour that 



requires the various team members to use their different 
skills collaboratively to accomplish a single, principal ac- 
tivity [11]. Reports of the use of robotic surgery suggest 
that a number of factors are important for successful in- 
tegration, such as having a highly motivated [12] and/or 
dedicated robotic team [13-15] and additional staff [16]. 
Operating theatre (OT) staff consider teamwork skills to 
be critical for easing the integration of robotic surgery, 
as is having predefined protocols and explicit communi- 
cation in the event of deviation from the protocol [17]. 
There is also acknowledgement that there is a learning 
curve for the whole team [18], not just the surgeon, 
and that the whole team requires training [19]. How- 
ever, such recommendations come from small case 
series (descriptive non-randomised studies) undertaken 
in single institutions, typically by dedicated robotic sur- 
gery enthusiasts [3], so that little is known about the 
contextual factors that are necessary for the successful 
integration of robotic surgery into healthcare organisa- 
tions more broadly. 

Existing evaluations of robotic surgery also fail to con- 
sider the impact of robotic surgery on communication, 
teamwork, and decision making in the OT. Robotic sur- 
gery significantly changes the spatial configuration in the 
OT, with the surgeon at a distance from the patient and 
team. The surgeon's visual attention is focused on the 
three-dimensional image provided by the robot, inhibit- 
ing face-to-face communication during the operative 
part of the procedure. More generally, the size of the 
robot introduces physical space constraints, resulting in 
a new choreography of movement around the patient 
[17]. The impact of this change in spatial configuration 
on communication and teamwork in the OT is not a 
topic that has been explored in evaluations of robotic 
surgery, which typically focus on the role of the surgeon 
[20]. The spatial configuration of team members and 
technology in the OT influence the gathering of infor- 
mation that is used to inform decision making [21,22]. 
More generally, the spatial configuration of OT teams is 
not arbitrary but affords particular views of the patient, 
the rest of the team, and different tools and technolo- 
gies, with the result that different team members have 
access to different information to inform their decision 
making [23]. The nature of the decision making tasks of 
the OT team may be impacted with robotic surgery. 
Surgeons report a sense of both physical and psycho- 
logical isolation from the patient in robotic surgery, 
and he/she is more dependent on the rest of the team 
communicating the status of the patient to maintain 
situation awareness [17,24]. Consequently, it has been 
argued that decision making in robotic surgery is es- 
sentially collaborative [24]. In the event of a complica- 
tion, more of the burden falls on the rest of the team to 
respond, increasing the importance of the team having 
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a shared situation awareness of what is happening in 
the operative field and how far they are through the 
procedure [17]. 

Two small studies have looked specifically at differ- 
ences in communication between laparoscopic and ro- 
botic surgery [25-27]. Both studies found a significant 
increase in oral communication between the surgeon 
and the rest of the team in robotic surgery, particularly 
in relation to the orientation and localisation of organs 
and the manipulation of instruments, with the effect 
found to be more pronounced in teams that have less 
experience in robotic surgery [25]. If use of robotic 
surgery interferes with standard practices of coordin- 
ation among the OT team, the achievement of seam- 
less, efficient and timely teamwork may be hampered. 
It is important to understand any change in communi- 
cation patterns because of the well-documented rela- 
tionship between communication and patient safety, 
with failures in communication and teamwork being 
identified as key factors in adverse events in the OT 
[28]. Communication and teamwork around robotic 
surgery are likely to be influenced by processes associ- 
ated with the introduction of robotic surgery, such as 
training and changes in team structure, but equally the 
integration of robotic surgery in surgical practice may 
be dependent on the extent to which it is consistent 
with existing practices for coordination. 

For robotic surgery to provide the most benefit for pa- 
tients, it is first necessary to understand the organisa- 
tional and social factors that support the successful 
integration of robotic surgery, by which we mean that it 
becomes embedded into surgical practice, being used 
routinely and successfully for surgical operations where 
it offers advantages to the patient. It is also necessary to 
understand the impacts of robotic surgery on communi- 
cation, teamwork, and decision making in the OT and 
how OT teams manage those impacts. 

Aims and objectives 

The aim of this project is to understand how and in what 
circumstances robotic surgery produces both intended and 
unintended outcomes. This will be achieved through 
a realist process evaluation, running alongside an 
existing randomised controlled trial (RCT) comparing 
laparoscopic and robotic rectal cancer surgery for the 
curative treatment of rectal cancer. The study has the 
following research objectives: 

1. To contribute to the interpretation and reporting 
of the trial results by investigating how variations 
in implementation of robotic surgery, and the 
context in which robotic surgery is implemented, 
impact on outcomes such as operation duration, 
conversion to open surgery, and complications; 



2. To produce actionable guidance for healthcare 
organisations on factors likely to facilitate successful 
implementation and integration of robotic surgery; and 

3. To produce actionable guidance for OT teams on 
how to ensure effective communication and 
teamwork when undertaking robotic surgery. 

Methods and design 

Overall design 

We will undertake a realist process evaluation that will 
run alongside ROLARR (RObotic versus LAparoscopic 
Resection for Rectal Cancer), an international, multi- 
centre prospective, randomised, controlled, unblended 
parallel-group trial, where the primary outcome is con- 
version to open surgery (as an indicator of technical 
difficulty) [29]. Process evaluations are predominantly 
qualitative studies that are typically undertaken along- 
side a trial, but may be undertaken in preparation for a 
trial or after a trial [30], and explore how the interven- 
tion is implemented [31]. This involves defining the ac- 
tive components of the intervention and investigating 
contextual factors that affect its implementation. 

Realist evaluation is increasingly popular as a method 
for evaluating the implementation of complex interven- 
tions in healthcare [32-36] and has been applied in a var- 
iety of fields within health systems research [37]. It does 
not employ particular methods of data collection but of- 
fers a framework for understanding for whom and in what 
circumstances complex interventions work. It involves 
building, testing and refining the underlying assumptions 
or theories of how the intervention is supposed to work 
[38] . Realist evaluation can complement RCTs in a number 
of ways [39]. Previously, it has been used in preparation for 
an RCT, to develop hypotheses that were then tested in the 
trial [40,41], and for a process evaluation following an 
RCT, to understand the results of the trial, in terms of how 
and why the outcomes were achieved [42,43]. 

Phase I. Formulation of CMO configurations 

The unit of analysis in realist evaluation is not the inter- 
vention but the theories concerning the mechanisms 
through which the intervention produces certain outcomes 
in particular contexts. A first task is to identify these theor- 
ies. In Phase I, the first 'theory elicitation' stage of a realist 
synthesis will be undertaken to catalogue stakeholders' the- 
ories concerning how robotic surgery becomes embedded 
into surgical practice and its impacts. Such theories are to 
be found in guidance documentation (e.g., for robotic sur- 
gery), position papers, professional journals such as the 
'Health Service Journal' and the 'Nursing Times,' publica- 
tions of the Royal Colleges, blogs, thought pieces, advocacy 
pieces, and critical pieces, and so the review will focus on 
this grey literature. The output of the review will be a series 
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of candidate theories in the form of Context-Mechanism- 
Outcome (CMO) configurations. 

Telephone interviews will be conducted with staff in 
National Health Service (NHS) hospital Trusts (pro- 
viders) in England that are using robotic surgery for rec- 
tal cancer resection. This will include Trusts that are 
participating in the trial and those that are not. Inter- 
views will be semi-structured and conducted using the 
'teacher learner cycle' [44]. Here, the interviewer de- 
scribes, through their interview questions, the candidate 
theories to the interviewee, who is then invited to com- 
ment, expand and discuss the theories based on their ex- 
perience of the intervention. Through this process, the 
interviewer channels the interviewee's responses to the 
task of developing and refining the theories. The inter- 
viewer proceeds to formalise the interviewee's theories, 
based on the information they have given, and the inter- 
viewee is then invited to comment on that formalisation. 
Consequently, the interview is a vehicle for enabling key 
participants to revise and expand the theory and gener- 
ate new theories. It is essential that the study captures 
the perspectives of all professional groups that may in- 
fluence the effectiveness of the introduction of robotic 
surgery [24]. Interviews will first be held with one of the 
surgeons in each Trust and, through them, we will 
identify other members of the OT team to interview 
(surgeons, anaesthetists, theatre nurses, ODPs, trainee 
surgeons) as well as hospital administrators and man- 
agers who were involved in the introduction of robotic 
surgery into the Trust. All interviews will be audio re- 
corded and transcribed verbatim. 

An iterative approach to data collection and analysis 
will be taken in this phase, to support the gathering of 
further data on emergent themes. Interview transcripts 
will be entered into a qualitative software programme 
(NVivo 10) for indexing. Thematic analysis will be used 
to analyse the data [45]. Following the realist strategy, 
indexing of the data will focus on identifying inter- 
viewees' accounts of how outcome patterns are formed 
by mechanisms and contexts [43]. In addition, codes de- 
veloped inductively will be used to index the data. Simi- 
larities and differences in the stakeholder theories will 
be identified and used to further refine the emerging 
CMO configurations. Key CMO configurations will then 
be selected for empirical testing in Phase II. 

Phase II. Empirical testing of CMO configurations 

Four case sites will be selected, three of which will be 
participants in the ROLARR trial and one which is not 
(on the basis that only looking at sites in the trial would 
limit the generalisabUity of the findings, as sites in the trial 
could be considered to have successfully embedded robotic 
surgery into their practice). Case sites will be purposively 
sampled to ensure variation in the contextual factors 



identified as being significant in Phase I of the research. 
These are likely to include: process through which the tech- 
nology was introduced (organisation led vs. clinician led); 
level of experience with robotic surgery; and whether dedi- 
cated robotic teams are employed. 

In realist evaluation, a mixture of qualitative and quan- 
titative methods is important to gather data on the 
mechanisms and contexts of an intervention as well as 
its impacts [46]. Data will be collected using a range of 
methods, which are flexible enough to allow exploration 
of a variety of CMO configurations. However, the data 
collection protocol will be revised and further specified 
at the end of Phase I in light of the theories to be tested. 

Data collection 
Structured observation 

Teamwork during operations will be assessed using OTAS 
(Observational Teamwork Assessment for Surgery) [47]. 
OTAS comprises ratings on five team behaviour constructs: 
(i) Communication; (ii) Coordination; (iii) Cooperation and 
back up behaviour; (iv) Leadership; and (v) Team monitor- 
ing and situation awareness. These behaviours are assessed 
during observation of the surgery, with each behaviour 
scored on a 7-point scale. OTAS distinguishes between dif- 
ferent subteams in the OT (surgeons, anaesthetists, and 
nurses) and different phases of a procedure (pre-, intra-, 
and post-operative). For one operation, a total of 45 behav- 
ioural ratings are generated (5 behaviour constructs x 3 
subteams x 3 phases). Researchers will also record add- 
itional information for each operation, such as the team 
composition, each team member's level of experience of ro- 
botic surgery, duration of each phase of the operation, and 
whether there was a conversion to open surgery. 

Video 

To facilitate a close consideration of robotic surgery in 
use, all operations that are observed will be video re- 
corded. Video recording has been highlighted as an im- 
portant tool for understanding safety in the OT [48] and 
has been used successfully in a number of studies con- 
cerned with the impact of communication and team- 
work on surgical performance [49-51]. The use of two 
video cameras will allow for the capture of the surgeon's 
perspective on the surgical scene and the wider conduct 
of OT team members. 

Ettinograptiic observation 

Ethnography has been argued as an essential approach for 
studying the introduction of technology into healthcare set- 
tings [52]. It is an important complement to the structured 
observations, allowing unanticipated yet significant behav- 
iours and interactions that fall outside the scope of the 
observation tool to be recorded in the researcher's field 
notes. In addition, ethnographic observation is important 
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for getting a sense of how what happens in the OT fits 
within the broader context of work and for capturing those 
aspects of the context that cannot easily be measured, such 
as the culture of an organisation. Following in the ethno- 
graphic tradition, the researchers will, at least in the early 
stages of the study, keep the scope of the notes wide on the 
basis that what previously seemed insignificant may come 
to take on new meaning in light of subsequent events [53] 
and should give special attention to the indigenous mean- 
ings and concerns of the people studied [54]. In addition, 
the researchers will record incidents of observer effects 
{e.g., participants asking 'What are you writing?') to allow 
analysis of whether participants' awareness of the re- 
searchers' presence changed over time [55]. Field notes will 
be written up as soon after data collection as possible. 

Interviews 

Interviews will be semi-structured and will seek to gather 
data on those outcomes that cannot easily be gathered by 
other means, particularly those relating to the perceptions 
of members of the OT team {e.g., level of enthusiasm for 
robotic surgery, perceptions of teamwork, and perceptions 
of robotic surgery as an opportunity for training). In 
addition, due to the infrequency of such events, we are un- 
likely to see many conversions to open surgery or complica- 
tions (conversion to open surgery is expected to occur in 
less than 5% of operations), so we will gather OT team 
members' accounts of the reasons for such conversions. All 
interviews will be audio recorded and transcribed verbatim. 

Data analysis 

As in Phase I, an iterative approach to data collection 
and analysis will be taken. The overall approach to ana- 
lysis will involve initial comparisons in the processes and 
outcomes of interest (i.e., those specified in the CMO 



configurations) between laparoscopic and robotic sur- 
gery, before using the data from the robotic surgery op- 
erations to test the CMO configurations. We will try to 
draw on multiple sources of data to test each configur- 
ation. Thus, it is through testing the CMO configura- 
tions that the various sources of data will be integrated. 
Table 1 provides some example theories, based on our 
current understanding of the literature, and indicates 
what data could be used for testing each theory. 

OTAS 

Initial analysis of OTAS scores will use a mixed model ana- 
lysis of variance (ANOVA), with case site and sub-team as 
between-subjects factors and surgery type (laparoscopic vs. 
robotic), phase, and behaviour as within-subjects factors 
[47]. We will then test the CMO configurations. For ex- 
ample, this could involve checking for a difference in the 
overall OTAS score in those case sites where the OT team 
had been involved in implementation compared to those 
case sites where they were not involved. 

Video 

We will follow standard methods outlined in the litera- 
ture on video and the analysis of work practice [56], 
which draw heavily on ethnomethodology [57] and con- 
versation analysis [58]. This analysis will be undertaken 
by multiple members of the research team, and team 
'video review sessions' will be a routine and regular fea- 
ture of project work. Given the complex and highly spe- 
cialised character of the setting, specific video extracts 
and preliminary analytic observations will be discussed 
with participants at each case site (and the clinical mem- 
bers of the research team) to ensure that the findings are 
robust, to generate alternative avenues for inquiry and to 
discuss implications of the findings for practice. 



Table 1 Example theories presented as CMO configurations, with 

Context + Mechanism 



data to support testing 

= Outcome pattern 



Data 



Experienced teams + Knowledge of how to overcome difficulties in 
set-up and positioning of the robot 



+ OT team perceive benefits for patients 



Whole OTteam 
involved in 
implementation 

Physical separation + OT team less aware of surgeon's actions 
between surgeon 
and OT team 

Dedicated robotic + Develop strategies to deal with physical separation 
teams 

Surgical trainee as + Physical separation and different views of operative 
part of team field makes it harder for surgeon to explain what is 

happening and monitor trainee's understanding 

More experienced + Understand need to support surgeon's situation 
teams awareness 



Easier access to patient; Reduced 
operation duration; Reduced conversion 
to open surgery/complications 

Increased motivation among team 
members to work together to develop 
solutions to problems 

Reduced coordination; Increased 
operation duration 

Effective coordination, teamwork, 
communication; Reduced operation 
duration 

Reduced satisfaction amongst surgeon 
and trainee in robotic surgery as 
opportunity for training 

Increased verbal communication of 
patient state to surgeon; Increased 
situation awareness of surgeon 



Video recordings, 
operation duration, 
interviews 

Video recordings, 
OTAS, interviews 



OTAS, video 
recordings, 
operation duration 

OTAS, video 
recordings, 
operation duration 

Video recordings, 
interviews 



Video recordings, 
OTAS 
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Ethnographic field notes and interview transcripts 

Field notes and interview transcripts will be entered into 
NVivo 10 for indexing and will be analysed using the 
methods outlined for the analysis of the interview data in 
Phase I. This will identify data to support or refute particu- 
lar CMO configurations, as well as identifying additional 
CMO configurations. 

Phase III. Assessing the generalizability of CMO 
configurations 

Interviews will be conducted at the four case sites with 
participants from different surgical disciplines to assess 
the generalisability of the CMO configurations that re- 
sult from Phase II and to further refine them to reflect 
the experience of a broader range of surgical disciplines. 
The interviews will be conducted using the 'teacher 
learner cycle', as in Phase I. Again, a range of partici- 
pants (surgeons, anaesthetists, theatre nurses, ODPs, 
trainee surgeons) from a range of surgical disciplines in 
which robotic surgery is being used will be included. All 
interviews will be audio recorded and transcribed verba- 
tim. Interview transcripts will be analysed using the 
methods outlined for the analysis of the interview data 
in Phase I. 

Ethical considerations 

Phase I of the study has been approved by the University 
of Leeds School of Healthcare Research Ethics Commit- 
tee (SHREC/RP/339). NHS Research Ethics Committee 
approval for Phases II and III of the study has been 
granted (13/YH/0153). 

Discussion 

This paper describes the protocol for a realist process 
evaluation that uses multiple methods to understand 
how and under what circumstances robotic surgery is ef- 
fectively introduced into routine practice; and how and 
under what circumstances robotic surgery impacts team- 
work, communication and decision making, and subse- 
quent patient outcomes. The study will provide actionable 
guidance for healthcare organisations on factors likely to 
facilitate successful integration of robotic surgery and for 
OT teams on how to ensure effective communication and 
teamwork when undertaking robotic surgery. 

There has been much work in recent years on methods 
for evaluating complex interventions [9,10,31,59,60]. At the 
same time, there has been work on methods for assessing 
surgical innovations, on the basis of their inherently com- 
plex nature [61,62], with some arguing for the inclusion of 
qualitative data collection alongside RCTs of surgical proce- 
dures [63]. Process evaluations are recommended when 
evaluating complex interventions because, although the 
RCT design remains as the most reliable method of deter- 
mining effectiveness [9], it is necessary to understand the 



mechanisms through which the intervention achieves its 
outcomes [59]. Without this, effective aspects of the inter- 
vention may go unmeasured, raising concerns about the 
validity and reliability of the results of an evaluation [64] 
and preventing replication [65]. Process evaluations are 
particularly important in multicentre trials in which the 
intervention may be implemented in different ways [31]. 
Understanding how the components of the intervention 
and the context vary across sites can assist in interpreting 
differences in results. 

However, the ability of process evaluations to shed 
light on how an intervention achieves its outcomes has 
been constrained by a tendency to focus on intervention 
components rather than on mechanisms through which 
the outcomes of interest are generated [66]. Where 
mechanisms are examined, the tendency has been to de- 
velop hypotheses about the relationship between inter- 
vention components, context, and outcomes, without 
explicitly testing those hypotheses. The advantage of 
realist evaluations is that they explain how different con- 
texts trigger particular mechanisms which, in turn, give 
rise to certain outcomes. Thus it increases the specificity 
of our understanding of the relationship between con- 
text, mechanisms and outcomes. 

Discussions with the ROLARR team suggest that the 
process evaluation will be able to provide insight to sup- 
port the interpretation of the trial data in terms of 
understanding any increase in operation duration in ro- 
botic surgery and what leads to conversion to open 
surgery or to complications. In developing the CMO 
configurations and selecting CMO configurations for 
testing, attention will be paid to the contexts and mech- 
anisms that may relate to such outcomes. Subject to re- 
cruitment, from the data collected in Phase I, we will be 
able to provide an account of the different ways in which 
robotic surgery was implemented in all English ROLARR 
sites, in terms of components of the intervention. Com- 
bining these data with the outcome data from the trial 
will allow for testing of CMO configurations that relate 
to the trial outcomes and can assist in understanding 
differences between sites. Inclusion of these findings into 
the reporting of the ROLARR trial will provide import- 
ant information for healthcare organisations that are 
considering introducing robotic surgery. 

Despite the successful use of realist methods in process 
evaluations alongside cluster RCTs of complex interven- 
tions and claims by authors of such studies that one of the 
strengths of realist evaluation is its ability to deal with com- 
plexity [37], the role that realist approaches can take in 
understanding the outcomes of RCTs of complex interven- 
tions has been disputed [66-68]. Some would say that realist 
evaluation is epistemologically antagonistic to the use of 
RCTs [69], and it has also been claimed that realist evalu- 
ation does not deal well with complex multi-site 
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interventions with multiple outcomes [69]. Certainly, we 
would agree with those who have called for further schol- 
arly debate on the place of realist evaluation in RCTs [68], 
and the proposed study will contribute to that debate, as 
well as contributing to the development of methods for the 
evaluation of surgical innovations. 
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